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WHAT IS CLAIMED IS: 

1. A computer readable medium having a markup language for 
execution on a client device in a client/server system, the 
markup language comprising an instruction indicating a 
grammar to associate with input entered through the client 
device. 

2 . The computer readable medium of claim 1 wherein the 
instruction indicating a grammar provides a reference to a 
location of the grammar. 

3. The computer readable medium of claim 1 wherein the 
grammar is for one of speech recognition, handwriting 
recognition, gesture recognition and visual recognition. 

4 . The computer readable medium of claim 3 wherein the 
instruction indicating a grammar includes a reference to a 
grammar for speech recognition. 

5. The computer readable medium of claim 4 wherein the 
markup language comprises one of HTML, XHTML, cHTML, XML, and 
WML. 

6. The computer readable medium of claim 4 wherein the markup 
language comprises a scripting language. 

7. The computer readable medium of claim 4 wherein the markup 
language comprises synchronized multimedia markup language. 

8 . The computer readable medium of claim 1 wherein the 
markup language includes an instruction for receiving a 
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recognition result pertaining to recognized speech and 
associating the result with a data field on the client 
device . 

9. The computer readable medium of claim 8 wherein the 
instruction for receiving a recognition result associates the 
recognition result to a plurality of data fields. 

10. The computer readable medium of claim 1 wherein the 
markup language includes an instruction to audibly render an 
indication when the speech was not recognized. 

11. The computer readable medium of claim 1 wherein the 
markup language includes an instruction to visually render an 
indication when the speech was not recognized. 

12 . The computer readable medium of claim 1 wherein the 
markup language includes an instruction to set a time period 
related to speech recognition. 

13 . The computer readable medium of claim 12 wherein the 
time period indicates a maximum period of silence from a 
start recognition instruction. 

14 . The computer readable medium of claim 12 wherein the 
time period indicates a maximum period before a result must 
be returned after detection of speech. 

15 . The computer readable medium of claim 12 wherein the 
time period indicates a maximum period before a result must 
be returned after a start recognition instruction. 
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16. The computer readable medium of claim 12 wherein the 
time period indicates a minimum period of silence to indicate 
an end of speech. 

17. The computer readable medium of claim 1 wherein the 
markup language includes an instruction indicating a 
confidence measure to use for speech recognition. 

18. The computer readable medium of claim 1 wherein the 
grammar comprises a DTMF grammar. 

19. The computer readable medium of claim 18 wherein the 
markup language includes an instruction for handling a DTMF 
event . 

20. The computer readable medium of claim 1 wherein the 
markup language includes an instruction for handling a call 
control event . 

21. The computer readable medium of claim 1 wherein the 
markup language includes an instruction indicating for 
audibly prompting. 

22. The computer readable medium of claim 21 wherein the 
markup language includes an instruction for prompting by 
converting text to speech. 

23. The computer readable medium of claim 21 wherein the 
markup language includes an instruction for prompting by 
playing a selected audio stream. 
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24. The computer readable medium of claim 21 wherein the 
markup language includes an instruction for retrieving a 
value for use in prompting. 

25. The computer readable medium of claim 21 wherein the 
markup language includes an instruction for related to 
halting prompting. 

26. A computer readable medium including instructions 
readable by a computer which, when implemented, cause the 
computer to handle information by performing steps 
comprising : 

receiving a markup language page from a web server 

having a field for input data; 
receiving input from a user related to the field; and 
sending data indicative of the input and an indication 

of a grammar for recognition. 

27. The computer readable medium of claim 26 wherein the 
indication provides a reference to locations of the grammars. 

28. The computer readable medium of claim 26 wherein the 
indication includes a reference to a language for speech 
recognition. 

29. The computer readable medium of claim 26 wherein the 
markup language comprises one of HTML, XHTML, cHTML, XML and 
WML. 

30. The computer readable medium of claim 2 6 wherein the 
markup language comprises a scripting language. 
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31. The computer readable medium of claim 26 wherein the 
markup language comprises a synchronized markup language. 

32. The computer readable medium of claim 26 and wherein the 
10 input comprises speech, and further including instructions, 

which when implemented, comprise: 

processing the input speech to provide data indicative 
of the input speech. 

15 33. The computer readable medium of claim 32 wherein 
processing includes normalizing the data indicative of the 
input speech. 

34. The computer readable medium of claim 32 wherein 
2 0 processing includes generating data indicative of parameters 

of the input speech. 

35. The computer readable medium of claim 26 wherein the 
input comprises speech and the grammar comprises a speech 

25 recognition grammar. 

36. The computer readable medium of claim 26 wherein the 
input comprises DTMF input and the grammar comprises a DTMF 
grammar . 

30 

37. A method for recognition in a client/server network, the 
method comprising: 

35 receiving a markup language page having a field for 

input data on a client device connected to a 
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5 network from a web server at an address on the 

network different than the client device; 
receiving input from a user related to the field on the 

client device; and 
sending data indicative of the input and an indication 
10 of a grammar for recognition to a recognition 

server at an address on the network different than 
the client device. 

38. The method of claim 37 and further comprising: 

15 normalizing the data indicative of the input prior to 

sending the data. 

39. The method of claim 37 wherein the indication provides a 
reference to location of the grammar. 

20 

40. The method of claim 37 wherein the markup language 
comprises one of HTML, XHTML, cHTML, XML and WML. 

41. The method of claim 37 and further comprising: 

25 receiving a recognition result pertaining to recognized 

speech and associating the result with a data field 
on the client device. 

42. The method of claim 41 wherein receiving a recognition 
result includes associating the recognition result to a 

3 0 plurality of data fields. 

43. The method of claim 37 wherein the markup language 
comprises a scripting language. 
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44. The method of claim 37 wherein the markup language 
comprises a synchronized markup language. 



45. A computer readable medium having a markup language for 
execution on a client device in a client/server system, the 
markup language comprising an instruction indicating an 
object model element having attributes for recognition. 

46. The computer readable medium of claim 45 wherein the 
element is for one of speech recognition, handwriting 
recognition, gesture recognition, DTMF recognition and visual 
recognition. 

47. The computer readable medium of claim 45 wherein the 
element comprises an indication of a grammar for recognition. 

48. The computer readable medium of claim 45 wherein the 
element comprises an indication for associating recognition 
result to a data field. 

49. The computer readable medium of claim 45 wherein the 
element comprises an indication for associating recognition 
result to a plurality of data fields. 

50. The computer readable medium of claim 45 wherein the 
markup language includes instructions for handling an event. 

51. The computer readable medium of claim 50 wherein the 
event pertains to a time period. 
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52. The computer readable medium of claim 50 wherein the 
event pertains to whether recognition was obtained. 

53. The computer readable medium of claim 50 wherein the 
event pertains to when a DTMF key is pressed. 

54. The computer readable medium of claim 53 wherein the 
event pertains to call control. 

55. The computer readable medium of claim 45 wherein the 
element pertains to audibly prompting a user. 

56. The computer readable medium of claim 45 wherein the 
markup language comprises one of HTML, XHTML, cHTML , XML and 
WML. 

57. The computer readable medium of claim 45 wherein the 
markup language comprises a scripting language. 

58. The computer readable medium of claim 45 wherein the 
markup language comprises a synchronized markup language. 

59. A computer readable medium having a markup language for 
execution on a client device in a client/server system, the 
markup language comprising an instruction indicating an 
object model element having attributes for audibly prompting. 

60. The computer readable medium of claim 59 wherein the 
markup language comprises one of HTML, XHTML, cHTML, XML and 
WML. 
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5 61. The computer readable medium of claim 59 wherein the 
markup language comprises a scripting language . 

62. The computer readable medium of claim 59 wherein the 
markup language comprises a synchronized markup language. 

10 

63. The computer readable medium of claim 59 wherein the 
element comprises playing an audio file. 

64. The computer readable medium of claim 59 wherein the 
15 element comprises converting text -to- speech. 

65. The computer readable medium of claim 64 wherein the 
element obtains dynamic content for converting text-to- 
speech. 

20 

66. The computer readable medium of claim 59 wherein one of 
the attributes comprises a period of time when prompting can 
be interrupted. 

25 67. The computer readable medium of claim 59 wherein the 
markup language includes instructions for handling an event 
related to prompting. 

68. The computer readable medium of claim 67 wherein the 
30 event pertains to whether prompting is being interrupted. 



